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Abstract 
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1 Introduction 

Lagrangian systems play a fundamental role describing motion in mechanics. The im- 
portance of such systems is related to the fact that they can be derived via the least-action 
principle using differentiable manifolds @|. Nevertheless, some important physical sys- 
tems involve functions that are non-differentiable. 

A non-differentiable calculus was introduced in 1992 by Nottale H131I14II . A rigorous 
foundation to Nottale's scale-relativity theory was recently given by Cresson |[5l[6l[Hl- 
The calculus of variations developed in (8]| cover sets of non-differentiable curves, by 
substituting the classical derivative by a new complex operator, known as the scale 
derivative. In |[2l[3l Almeida and Torres obtain several Euler-Lagrange equations for 
variational functionals and isoperimetric problems of the calculus of variations defined 
on a set of Holder curves. 

The embedding procedure, introduced for stochastic processes in 0, can always 
be applied to Lagrangian systems flUEl. ln this work we prove that the embedding 
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of Lagrangian and Hamiltonian systems with time delays, via the least-action principle, 
respect the principle of coherence. For the importance of variational and control systems 
with delays we refer the reader to P"0l and references therein. 

The article is organized as follows. A brief review of the quantum calculus of llHIl , 
which extends the classical differential calculus to non-differentiable functions, is given 
in Section [2l In Section [3] we discuss the non-differentiable embedding within the time 
delay formalism: Section 13.11 is devoted to the development of the non-differentiable 
embedding to variational problems with time delay, where a causal and coherent em- 
bedding is obtained by restricting the set of variations; in Section [3T21 we prove that 
the non-differentiable embedding of the corresponding Hamiltonian formalism is also 
coherent. 



2 The Quantum Calculus of Cresson 

Let X d denote the set R d or C d , d e N, and / be an open set in R with [t u t 2 ] C I, 
t x < t 2 . We denote by Q (/, X d ) the set of functions / : / -> X d and by C° (I, X d ) the 
subset of functions of Q (/, X d ) that are continuous. 

Definition 2.1 (The e-left and e-right quantum derivatives). Let / G C° (/, M. d ). For all 
e > 0, the e-left and e-right quantum derivatives of /, denoted respectively by A~ f and 
are defined by 

Ar/(t) = /gWM and A , /(t) = /(' + 0-/M. 

e e 

Remark 2.2. The e-left and e-right quantum derivatives of a continuous function / cor- 
respond to the classical derivative of the e-mean function f° defined by 

nt+ae 

e Jt 

Next we define an operator which generalize the classical derivative. 

Definition 2.3 (The e-scale derivative). Let f E C° (I, R d ) . For all e > 0, the e-scale 
derivative of f , denoted by — —, is defined by 

^ = ^(A^ + Acr/)-^(A £ + /-A 7 /)], 
where i is the imaginary unit. 

Remark 2.4. If / is differentiable, we can take the limit of the scale derivative when e 

goes to zero. We then obtain the classical derivative — of /. 

dt 
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We also need to extend the scale derivative to complex valued functions. 

Definition 2.5. Let / G C° (/, C d ) be a continuous complex valued function. For all 

DJ 

e > 0, the e scale derivative of /, denoted by -j=j^-> is defined by 

□ e / _ a e Re(/) □ £ Im(/) 

nt nt at ' 

where Re(/) and Im(/) denote the real and imaginary part of /, respectively. 

In Definition 12.31 the e-scale derivative depends on e, which is a free parameter 
related to the smoothing order of the function. This brings many difficulties in applica- 
tions to Physics, when one is interested in particular equations that do not depend on an 
extra parameter. To solve these problems, the authors of [8J introduced a procedure to 
extract information independent of e but related with the mean behavior of the function. 

Definition 2.6. Let C° conv (I x (0, 1), R d ) C C° (I x (0, 1), R d ) be such that for any 
function / G C® onv (I x (0, 1), R d ) the lim f(t, e) exists for any t G I; and E be a com- 
plementary of C° conv (I x (0, 1), R d ) in C° (i x (0, 1), R d ). We define the projection 
map 7r by 

vr : C° coriv (I x (0, 1), R d ) © E C° conv (I x (0, 1), R d ) 

fconv f E ' ^ f conv 

and the operator (■) by 

(•) : C° (I x (0,1), R d ) -)> 

/ h+ (/):t^lirnvr(/)(t,e). 

We now introduce the quantum derivative of / without the dependence of e |[8l. 
Definition 2.7. The quantum derivative of / in the space C° (/, R d ) is given by the rule 

□/ /O e f\ 

(2.1) 



Dt \ at 

The scale derivative (12.11 ) has some nice properties. Namely, it satisfies a Leibniz 
and a Barrow rule. First let us recall the definition of an a-Holderian function. 

Definition 2.8 (Holderian function of exponent a). Let / G C° (/, R d ). We say that / 
is a-Holderian, < a < 1, if for all e > and all t,t' G I there exists a constant c > 
such that \t — t'\ ^ e implies \\f(t) — f(t') || ^ ce a , where || • || is a norm in R d . The set 
of Holderian functions of Holder exponent a is denoted by H a (I, R d ). 

□ 

In what follows, we will frequently use □ to denote the scale derivative operator — . 
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Theorem 2.9 (The quantum Leibniz rule [8]). For f G H a (I, R d ) and g G H p (i, R d ), 
with a + (3 > 1, one has 

□(/ ■ g)(t) = Df(t) ■ g(t) + f(t) ■ Dg(t) . (2.2) 

Remark 2.10. For / G C 1 (I, R d ) and g G C 1 (J, R d ), one obtains from (HJ) the clas- 
sical Leibniz rule (/ • g)' — f ■ g + f ■ g'. For convenience of notation, we sometimes 
write ©as(/. g) n (t) = f n (t) ■ g(t) + f(t) ■ g u (t). 

Theorem 2.11 (The quantum Barrow rule flU). Let f G C°([t 1 ,t 2 ],M.) be such that 
□//□i is continuous and 

lim / 2 (^P) (t)dt = 0. (2.3) 



^° J tl V □* / E 



Then, 



ti 



Qt (t)dt = f(t 2 )-f(t 1 ). 



3 The Non-Differentiable Embedding with Time Delays 

Given two operators A and B, we use the notations 

(A ■ B)(y) = A(y)B(y) and (A o B)(y) = A(B(y)). 
Definition 3.1 (The A;th scale derivative). Let fceN. The operator D k is defined by 

D k = r = — o-.-o— , (3.1) 

nt k nt ot' 
□ . . 

where — appears exactly k times on the right-hand side of (I3.ll) . 

Definition 3.2 (The backward shift operator p T ). Given r > 0, the backward shift oper- 
ator p T is defined by p T (t) —t — r. 

Definition 3.3 (The operators [-]° and [•]*). Let r > 0, k G N. For convenience, we 
introduce the operators [-]° and [•]* by 

[y]f (t) = (t, y(f), LTy(f), . . . , n k y(t), (y o p *)(t), (Dy o . . . , (D* y o p-)(t)) 

and 

= (*, y(tW(t), . . . , yW(t), (y o pr)(t), (y' o . . . , (yW o ^)(t)) . 

When k = 1, we omit and use y to denote the derivative y', that is: 

[y]°(t) = (t, y(t), Dy(t),y(t - r), Dy(t - r)) 

and 

[y] T (0 = (t, y{t),y{t),y{t - r), y(t - r)). 
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Given a function / : R x (C d ) 2( - k+1 ^ — > C, we denote by F k,T the corresponding 
evaluation operator defined by F k,T = /[•]*, that is, 

Kt _ c°{i,c d ) — ► C°(I,C) 

Let f = {/i}i= ,...,n and g = {^}i= ,...,n be a finite family of functions fi,g { : 



x 



id\2 ft+i _j_ q an( j ^ifc.r an( j £* ,T 5 i = 1, . . . , n, be the corresponding family of 



evaluation operators. We denote by O f ,T the differential operator 



of; g r = E^' r -(S oGr * ,T )' (3 ' 2) 



i=0 



dt 



with the convention that i s m e identity mapping on C. As before, we omit k 

when k — 1: Of g = O f 'g. 

Definition 3.4 (Non-differentiable embedding of operators with time delay). The non- 
differentiable embedding of (13.21) . denoted by Emb n f 0* gj , is given by 

Ff- = Emb D (i^) = /,[.]?, ^ = Emb n (j^, G f * = Emb D (^) = 
3.1 Embedding of Variational Problems with Time Delay 

The fundamental problem of the calculus of variations with time delay is to minimize 

F[q}= / 2 L(t,q(t),q(t),q(t-T),q(t-r))dt (3.3) 
Jti 

subject to q(t) = 8{t), t E [ti — r,ti), and q(t 2 ) = q 2 , where t x < t 2 are fixed in R, 
r is a given positive real number such that r < t 2 — t\, 5 is a given piecewise smooth 
function, and q 2 e W 1 . We assume that admissible functions q are such that both q and 
q o p T belong to C 1 (i, R d ) . Note that, with our notations, (13.31) can be written as 



r[q]= r L[q] T (t)dt. 
Ju 



A variation of q e C 1 (/, R d ) is another function of C 1 (/, R d ) of the form q + eh 
with e a small number and h e C 1 (i, R d ) such that h(t) = for t G [h - r, ti) U {t 2 }. 
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Definition 3.5 (Extremal). We say that q is an extremal of funcional (|3.3I) if 







for any h e C 1 (l,R d ). 

A first idea to obtain a non-differentiable Lagrangian system with time delays is to 
embed directly the classical Euler-Lagrange equations with time delays. 

Theorem 3.6 (Euler-Lagrange equations with time delay |fTTfT2lQ . A function q G C 1 (/, R d ) 
is an extremal of (|3.3I) if and only if 



£[L 4 [q] T (t)+L 4 MAt + r)] 



d 
dt 



= L q [q} T (t) + L QT [q] T (t + r) , h<t<t 2 -T, 
L q [q] T {t) = L q [q] T (t) , t 2 -r<t<t 2 , 



(EL) 



where L^(t, q, q, q T , q T ) denotes the partial derivative of Lit, q, q, q T , q T ) with respect to 

£ e {q, 9,9r,gr}- 

The following theorem gives the non-differentiable embedding of the Euler-Lagrange 
equations with time delay (]EL|) . By (i, X d ) we denote the set of functions q such that 
both q and q o p T belong to C° (i, X d ) as well as O t q and (O l q) o p T for alii = 1, . . . , n. 

Theorem 3.7. Let the Lagrangian L be a (i, M d ) -function with respect to all its 
arguments, holomorphic with respect to q(t) and q(t — r), and real when q(t) and 
q(t — t) belong to M. d . The non-differentiable embedded Euler-Lagrange equations with 
time delay associated to L are given by 

= L q [q]°(t) + L qT [q}?(t + r), h<t<t 2 - r, (DEL) 
^L Dq [q]?(t) = L q [q]°(t), h-r<t<t 2 . 
Proof. The Euler-Lagrange equations (|ELI) can be written in the equivalent form 

Of, g (?)(t) = 0, te[txM 

with f and g given by 

' -L q [q] T (t)-L qT [q]r(t + r),l) if t e [t u t 2 - r] 
{-L q [q) T {t),l) ift e [t 2 -r,t 2 ] 



f[?]rW 



and 



[I, L q [q] T (t) + L q - T [q]r(t + t)) if t e [h, t 2 - r) 
1, L q [q} T (t)) if t G [t 2 — r, t 2 \. 

The intended conclusion follows now by a direct application of Definition 13 .41 



□ 



A Non-Differentiable Quantum Variational Embedding in Presence of Time Delays 7 



Remark 3.8. The Euler-Lagrange equations (ID-ELI) reduce to (IELI) when the functions 
are differentiable. 

Another approach to obtain a non-differentiable Lagrangian system with time delays 
is to embed the Lagrangian, and then to apply the least-action principle. The non- 
differentiable embedding of functional (|3.3I) is given by 

r n [q] = r L (t, q(t), nq(t), q(t - r), Dq(t -r))dt= [' L[y]*(t)dt. (3.4) 

In contrast with the original problem, the admissible functions q are now not necessarily 
differentiable: admissible functions q for (13.41) are those such that q G (/, R d ) . 

Let a, j3, e G Mbe such that < a, f3 < 1, a+(3 > 1 and \e\ <1.A variation of q G 
H a (I, R d ) is another function of H a (I, R d ) of the form q + eh, with h E H 13 (I, R d ) , 
such that h(t) = for t G [t± - r, t x ] U {t 2 }. 

Definition 3.9 (Non-differentiable extremal). We say that q is a non-differentiable ex- 
tremal of funcional (13.41) if 

^In[y + eh]\ E=o = (3.5) 

for any h G L 7 ^ (7,M d ). 

As in the classical case, the least-action principle has here its own meaning, i.e., 
we seek the non-differentiable extremals of funcional (|3.4I) to determine the dynamics 
of a non-differentiable dynamical system. The next theorem gives the Euler-Lagrange 
equations with time delay obtained from the non-differentiable least-action principle. 

Theorem 3.10. Let < a, (3 < 1 with a + > 1. If q G H a (I, R d ) satisfies Dq G 
H a (l,R d ) and (L Dq [q]^(t) + L n , T [g]°(t)) • h(t) satisfies condition ^3 far all h G 
H 13 (/, R d ), then function q is a non-differentiable extremal of 1^ if and only if 

( ^(L Dq [q]r(t)+L Dq Mr(t + T)) 

= L q [q}^{t) + L qT [q}^{t + T), h<t<t 2 -r, (EL DLAP ) 
^L Dq [q}^(t) = L q [q]°(t), t 2 -r<t<t 2 . 

Proof. Condition (13.51 ) gives 

(L g [q}*(t)-h(t) + L ng [q}V(t)-nh(t))dt 

+ (L qr [q]°(t) ■ h(t -t) + L Uqr [q]V(t) ■ Dh(t - r)) dt = . (3.6) 
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By the linear change of variables t = s + r in the last integral of (13.61) . and having in 
mind the fact that h(t) = on \t\ — r, ti], equation (|3.6I) becomes 



/ 2 T [{LM?(t) + L qT [q}?(t + r))-h(t) 

+ {L aq [q]*(t) + L aq Mr(t + r)) • Oh(t)] dt 



+ 



*2 



(Ljg]°(t) • h(t) + L Uq [q\r{t) ■ Oh(t)) dt = 0. (3.7) 



t 2 —T 



Using the hypotheses of the theorem, we obtain from Theorem |2.9| that 

-t 2 ~T 



I (L aq [q]?(t) + Ln q M?(t + r)) ■ Uh{t)dt 
Jti 



t 2 -T 



□ 

at 



{{Ln q [q}r(t) + L nqT [q}?(t + r))-h(t)}dt 



t 2 —T 



□ 
at 



{L Dq [q}°(t) + L agT [q]r(t + r)) • h(t)dt (3.8) 



and 



*2 



L Dq [q]°(t) ■ Dh(t)dt 



t 2 -T 



t 2 —T 



□ 



m {LuMrit) ■ Kt)) dt 



t 2 -T 



□ 



— (L nq [q]*(t))-h(t)dt. (3.9) 



Because (L Dq [q]^(t) + L D(?r [g]°(t + r)) • h(t) satisfies (Q for all h e H fi (l,R d ), 
using Theorem |2.1 H and replacing the quantities of (13.81) and (13.91) into (13.71) . we obtain 



t 2 —T 



L q [q]r(t) + Mg]°(t + (Md? (*) + W<?]°(* + r)) 



h(t)dt 



+ (Wg]?(*) + JW[?l?(* + ^))-M*)|* 



*2-r 



+ 



ta 

*2-T L 



i fl [ff]r (*) " ^ (M9lr (*)) 



/i(t)dt + Lnq[q]r{t) ■ Kt) 



1*2 

lt 2 -T 



0. 



The Euler-Lagrange equations with time delay <\EL aLA p\ ) are obtained using the fun- 
damental lemma of the calculus of variations (see, e.g., [fTTTl ). □ 

To summarize, the dynamics of a non-differentiable Lagrangian system with time 
delay are determined by the Euler-Lagrange equations ^ELqla^, via the D-least- 
action principle, respecting the principle of coherence: < \EL aL Ap\ > coincide with <\DEL\i . 
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3.2 Embedding of Optimal Control Problems with Time Delay 

In Section 13.11 we studied the non-differentiable variational embedding in presence of 
time delays. Now, we give a scale Hamiltonian embedding for more general scale prob- 
lems of optimal control with delay time. Following lfT0l[T2l . we define the optimal 
control problem with time delay as follows: 



rt2 

I T [q,u}= L(t,q(t),q(t-T),u(t),u(t-r))dt — > min , (3.10) 
Jti 

q(t) = if {t, q{t), q(t - r), u(t), u{t - r)) , (3.11) 

under given boundary conditions 

q(t) = 5(t), te[ti- r, h] , q(t 2 ) = q 2 , (3.12) 

where g G C 1 (I, R d ),u6 C° (I, R d ), the Lagrangian L: I xR 2d x R 2m -> R and the 
velocity vector (p : I x M. 2d x M. 2m — > M. d are assumed to be C 1 -functions with respect 
to all its arguments. Similarly as before, we assume that 5 is a given piecewise smooth 
function and q 2 a given vector in M d . 

Definition 3.11. We introduce the operators [-, -] r , [-, -, -] T , [-, -]° and [-, -]° by: 

1. [q,u] T (t) = (t,q(t),q(t - r),u(t),u(t - r)), where q e C 1 (l,R d ) and u G 
C° (l,R d ); 

2. [q,u,p] T (t) = (t,q(t),q(t-r),u(t),u(t-r),p(t)), where q^peC 1 (l,R d ) and 
ueC° (l,R d ); 

3. [q,u]°(t) = (t,q(t),q(t - r),u(t),u(t - r)), where q G H a (l,R d ) and u G 

H a (i,c d ); 

4. [q,u,p]°(t) = (t,q(t),q(t - r),u(t),u(t - r),p(t)), where q G H a (l,R d ) and 
u,peH a (l,C d )- 

Theorem 3.12 ( QI)l[l2]|). If (q, u) is a minimizer to problem (13 . 1 01) — (13 . 1 21) . then there 
exists a co-vector function p G C 1 (i, M d ) such that the following conditions hold: 

• the Hamiltonian systems 



q(t) = H p [q,u,p] T (t) , 

p(t) = -H q [q,u,p) T (t) - H qT [q,u,p} T (t + r) 
for ti < t < t 2 — t, and 



(3.13) 



q(t) = H p [q,u,p] T {t) , 
pit) = -H q [q,u,p] T (t) 



(3.14) 



fort 2 -T <t <t 



2> 
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• the stationary conditions 

H u [q,u,p] T (t) + H UT [q,u,p} T {t + t) = 0, (3.15) 
for t% < t < t 2 — t, and 

H u [q,u,p} T {t) = 0, (3.16) 

fort 2 -r <t < t 2 ; 

where the Hamiltonian H is defined by H[q, u, p] T (t) = L[q, u} T {t) + p(t) ■ ip[q, u] T (t). 

Lemma 3.13. Let H[q, u,p]^(t) = L[q,u}^(t) + p(t) ■ tp[q, u]^(t). The embedding of 
the Hamiltonian systems (13.131) and (13.141 ) are given, respectively, by 

'nq{t) = H p [q,u,p]°(t), 

np(t) = -H q [q,u,p}°(t)-H qT [q,u,p^(t + T), 
for ti < t < t 2 — r, and by 

'nq(t) = H p [q,u,p]^(t), 
np(t) = -H q [q,u,p]°(t), 

for t 2 — t < t < t 2 ; the embedding of the stationary conditions (13.151) and (13.161) are 
given, respectively, by 

H u [q, u, p]°(t) + H Ut [q, it, p]°(t + r) = 0, (3.19) 
for ti < t < t 2 — t, and by 

H u [q,u,p^(t) = 0, (3.20) 

for t 2 — r < t < t 2 . 

Definition 3.14. We call systems (13.171) and (13.181 ) the scale Hamiltonian systems with 
delay, while to (13.191 ) and ( 13.201) we call stationary conditions with delay. 

Lemma 3.15. The embedding of (13 . 1 0b — (13 .111) is given by 

I^[q,u]= L(t,q(t),q(t-T),u(t),u(t-r))dt — > min , (3.21) 
Jti 

Dq(t) = if {t, q{t), q(t - r),u{t),u{t - r)) , (3.22) 

where q, q o p T G H a (i, R d ) and u, u o p T e H a (i, C d ). 

Theorem |3 . 1 61 generalizes Theorem |3.12| for non-differentiable optimal control prob- 
lems with time delay. 
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Theorem 3.16. Let < a, (3 < 1 with a + (3 > 1. Assume that q G H a (/, R d ) satisfies 
Dq G H a (I, R d ) and (L nq [q] T u (t) + L Bqr [<?]□(£)) • h(t) satisfies condition (1231) for all 
h G f/^ If (q,u) is a minimizer to problem (|3.21| )- (|3.22| ) subject to given 

boundary conditions (13.121 ), then there exists a co-vector function p G H a (/, C d ) such 
that the following conditions hold: 

• the scale Hamiltonian systems with delay (|3.17l) and (13. 181) : 

• the stationary conditions with delay (13.191 ) and (13.201 ). 

Proof. We prove the theorem only in the interval ti < t < t 2 — r (the reasoning is 
similar in interval t 2 — r < t < t 2 ). Using the Lagrange multiplier rule, (I3.21|) - (|3.22| ) 
is equivalent to minimize the augmented functional J^[q, u,p] defined by 

J^[q, u,p}= [ 2 [H (t, q(t), q(t - r), u(t), u(t - r),p(t)) - p(t) ■ Dq(t)} dt. (3.23) 

The necessary optimality conditions (13.171 ) and (13.191 ) are obtained from the Euler- 
Lagrange equations <\EL nLAP ) applied to functional (13.231 ): 

( □ 

— (hjq[q, u, p] T u (t) + L Dgr [q, u, p)h(t + W 
= Ljg,«,_p]^(t) + h qT [q,u,p]n(t + T) 

— (Lnu[q, u, p\a(t) + h Dur [q, u, p\ T u (t + r)) 
= h u [q,u,p]n(t) +lL UT [q,u,p]^(t + r) 

— (Lqp[g,tt,p]n(t) +L DpT [g,n,p]n(t + r)) 
= L p [g,M,p]^(t) +h PT [q,u,p}^(t + T) 

( Dp(t) = -H q [q,u,p} T D (t)-H qT [q,u,p] T n (t + r) 
& < = H u [q,u,p} T n {t) + H UT [q,u,p] T n {t + r) 

[o = -nq(t) + H p [q,u,p]h(t), 
where L[q, u, p} T u (t) = H[q, u, p} T n {t) - p{t) ■ Uq{t). □ 

Remark 3.17. In the differentiable case Theorem 13.1 61 reduces to Theorem 13 .121 

Remark 3.18. The first equations in the scale Hamiltonian system with delay (13.171) and 
(13.181) are nothing else than the scale control system (13.221) . 

Remark 3.19. In classical mechanics, p is called the generalized momentum. In the 
language of optimal control, p is known as the adjoint variable lfT6l . 

Definition 3.20. A triplet (q,u,p) satisfying the conditions of Theorem 13 . 1 61 will be 
called a scale Pontryagin extremal. 
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Remark 3.21. If ip (t,q,q T ,u,u T ) = u, then Theorem 13 .161 reduces to Theorem 13.101 
Let us verify this in the interval ti < t < t 2 — r (the procedure is similar for t 2 — r < 
t < t 2 ). The stationary condition (13.191 ) gives p(t) = L u [q]^(t) + L UT [q]^(t + r) and 
the second equation in the scale Hamiltonian system with delay (13.171 ) gives Dp(t) = 
L q [q}^(i) + L qT [q]r(t). Comparing both equalities, one obtains the non-differentiable 
Euler-Lagrange equations with time delay <\ELqlap^ - In other words, the scale Pon- 
tryagin extremals (Definition 13 .201) are a generalization of the non-differentiable Euler- 
Lagrange extremals (Definition 13. 91 ). 

We conclude from Theorem 13.161 that the coherence principle is also respected for 
non-differentiable optimal control problems with time delay. 
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